Atlas-based segmentation of cochlear microstructures in cone beam CT.

PURPOSE: To develop an automated segmentation approach for cochlear microstructures [scala tympani (ST), scala vestibuli (SV), modiolus (Mod), mid-modiolus (Mid-Mod), and round window membrane (RW)] in clinical cone beam computed tomography (CBCT) images of the temporal bone for use in surgical simulation software and for preoperative surgical evaluation. METHODS: This approach was developed using the publicly available OpenEar (OE) Library that includes temporal bone specimens with spatially registered CBCT and 3D micro-slicing images. Five of these datasets were spatially aligned to our internal OSU atlas. An atlas of cochlear microstructures was created from one of the OE datasets. An affine registration of this atlas to the remaining OE CBCT images was used for automatically segmenting the cochlear microstructures. Quantitative metrics and visual review were used for validating the automatic segmentations. RESULTS: The average DICE metrics were 0.77 and 0.74 for the ST and SV, respectively. The average Hausdorff distance (AVG HD) was 0.11 mm and 0.12 mm for both scalae. The mean distance between the centroids for the round window was 0.32 mm, and the mean AVG HD was 0.09 mm. The mean distance and angular rotation between the mid-modiolar axes were 0.11 mm and 9.8 degrees, respectively. Visually, the segmented structures were accurate and similar to that manually traced by an expert observer. CONCLUSIONS: An atlas-based approach using 3D micro-slicing data and affine spatial registration in the cochlear region was successful in segmenting cochlear microstructures of temporal bone anatomy for use in simulation software and potentially for pre-surgical planning and rehearsal.

Standard Setting of Competency in Mastoidectomy for the Cross-Institutional Mastoidectomy Assessment Tool.

OBJECTIVE: Competency-based surgical training involves progressive autonomy given to the trainee. This requires systematic and evidence-based assessment with well-defined standards of proficiency. The objective of this study is to develop standards for the cross-institutional mastoidectomy assessment tool to inform decisions regarding whether a resident demonstrates sufficient skill to perform a mastoidectomy with or without supervision. METHODS: A panel of fellowship-trained content experts in mastoidectomy was surveyed in relation to the 16 items of the assessment tool to determine the skills needed for supervised and unsupervised surgery. We examined the consensus score to investigate the degree of agreement among respondents for each survey item as well as additional analyses to determine whether the reported skill level required for each survey item was significantly different for the supervised versus unsupervised level. RESULTS: Ten panelists representing different US training programs responded. There was considerable consensus on cut-off scores for each item and trainee level between panelists, with moderate (0.62) to very high (0.95) consensus scores depending on assessment item. Further analyses demonstrated that the difference between supervised and unsupervised skill levels was significantly meaningful for all items. Finally, minimum-passing scores for each item was established. CONCLUSION: We defined performance standards for the cross-institutional mastoidectomy assessment tool using the Angoff method. These cut-off scores that can be used to determine when trainees can progress from performance under supervision to performance without supervision. This can be used to guide training in a competency-based training curriculum.

Atlas-based segmentation of temporal bone surface structures.

PURPOSE: To develop a time-efficient automated segmentation approach that could identify surface structures on the temporal bone for use in surgical simulation software and preoperative surgical training. METHODS: An atlas-based segmentation approach was developed to segment the tegmen, sigmoid sulcus, exterior auditory canal, interior auditory canal, and posterior canal wall in normal temporal bone CT images. This approach was tested in images of 20 cadaver bones (10 left, 10 right). The results of the automated segmentation were compared to manual segmentation using quantitative metrics of similarity, Mahalanobis distance, average Hausdorff distance, and volume similarity. RESULTS: The Mahalanobis distance was less than 0.232 mm for all structures. The average Hausdorff distance was less than 0.464 mm for all structures except the posterior canal wall and external auditory canal for the right bones. Volume similarity was 0.80 or greater for all structures except the sigmoid sulcus that was 0.75 for both left and right bones. Visually, the segmented structures were accurate and similar to that manually traced by an expert observer. CONCLUSIONS: An atlas-based approach using a deformable registration of a Gaussian-smoothed temporal bone image and refinements using surface landmarks was successful in segmenting surface structures of temporal bone anatomy for use in pre-surgical planning and training.

Cross-Institutional Evaluation of a Mastoidectomy Assessment Instrument.

OBJECTIVE: The objective of this work is to obtain validity evidence for an evaluation instrument used to assess the performance level of a mastoidectomy. The instrument has been previously described and had been formulated by a multi-institutional consortium. DESIGN: Mastoidectomies were performed on a virtual temporal bone system and then rated by experts using a previously described 15 element task-based checklist. Based on the results, a second, similar checklist was created and a second round of rating was performed. SETTING: Twelve otolaryngological surgical training programs in the United States. PARTICIPANTS: In all, 65 mastoidectomy performances were evaluated coming from 37 individuals with a variety of temporal bone dissection experience, from medical students to attending physicians. Raters were attending surgeons from 12 different institutions. RESULTS: Intraclass correlation scores varied greatly between items in the checklist with some being low and some being high. Percentage agreement scores were similar to previous rating instruments. There is strong evidence that a high score on the task-based checklist is necessary for a rater to consider a mastoidectomy to be performed at the level of an expert but a high score is not a sufficient condition. CONCLUSIONS: Rewording of the instrument items to focus on safety does not result in increased reliability of the instrument. The strong result of the Necessary Condition Analysis suggests that going beyond simple correlation measures can give extra insight into grading results. Additionally, we suggest using a multiple point scale instead of a binary pass/fail question combined with descriptive mastery levels.

Atlas-Based Segmentation of Temporal Bone Anatomy.

PURPOSE: To develop a time-efficient automated segmentation approach that could identify critical structures in the temporal bone for visual enhancement and use in surgical simulation software. METHODS: An atlas-based segmentation approach was developed to segment the cochlea, ossicles, semicircular canals (SCCs), and facial nerve in normal temporal bone CT images. This approach was tested in images of 26 cadaver bones (13 left, 13 right). The results of the automated segmentation were compared to manual segmentation visually and using DICE metric, average Hausdorff distance, and volume similarity. RESULTS: The DICE metrics were greater than 0.8 for the cochlea, malleus, incus, and the SCCs combined. It was slightly lower for the facial nerve. The average Hausdorff distance was less than one voxel for all structures, and the volume similarity was 0.86 or greater for all structures except the stapes. CONCLUSIONS: The atlas-based approach with rigid body registration of the otic capsule was successful in segmenting critical structures of temporal bone anatomy for use in surgical simulation software.

Multi-Institutional Development of a Mastoidectomy Performance Evaluation Instrument.

OBJECTIVE: A method for rating surgical performance of a mastoidectomy procedure that is shown to apply universally across teaching institutions has not yet been devised. This work describes the development of a rating instrument created from a multi-institutional consortium. DESIGN: Using a participatory design and a modified Delphi approach, a multi-institutional group of expert otologists constructed a 15-element task-based checklist for evaluating mastoidectomy performance. This instrument was further refined into a 14-element checklist focusing on the concept of safety after using it to rate a large and varied population of performances. SETTING: Twelve otolaryngological surgical training programs in the United States. PARTICIPANTS: A total of 14 surgeons from 12 different institutions took part in the construction of the instrument. RESULTS: By using 14 experts from 12 different institutions and a literature review, individual metrics were identified, rated as to the level of importance and operationally defined to create a rating scale for mastoidectomy performance. Initial use of the rating scale showed modest rater agreement. The operational definitions of individual metrics were modified to emphasize "safe" as opposed to "proper" technique. A second rating instrument was developed based on this feedback. CONCLUSIONS: Using a consensus-building approach with multiple rounds of communication between experts is a feasible way to construct a rating instrument for mastoidectomy. Expert opinion alone using a Delphi method provides face and content validity evidence, however, this is not sufficient to develop a universally acceptable rating instrument. A continued process of development and experimentation to demonstrate evidence for reliability and validity making use of a large population of raters and performances is necessary to achieve universal acceptance.

Expert subjective comparison of haptic models for bone-drill interaction.

PURPOSE: A haptic algorithm to simulate the interaction between a surgical drill and bone using a constraint-based algorithm has been previously demonstrated. However, there has been no blinded study to determine whether this algorithm is preferred by professionals who commonly use this type of system METHODS: Fourteen otologic surgeons were presented with a spring-damper model and a constraint-based model of drill-bone interaction rendered on a low-cost haptic device with only linear feedback. The participants were blinded as to what algorithm they were using. They then answered survey questions about their opinions of the models. RESULTS: The surgeons overwhelmingly preferred the constraint-based model. They generally preferred the constraint-based model in the individual questions as well. CONCLUSIONS: Follow-up work can be done to fine-tune the parameters in the model, but this study shows that a sophisticated algorithm can make a significant difference even on a low-fidelity haptic device.

Integration of high-resolution data for temporal bone surgical simulations.

PURPOSE: To report on the state of the art in obtaining high-resolution 3D data of the microanatomy of the temporal bone and to process that data for integration into a surgical simulator. Specifically, we report on our experience in this area and discuss the issues involved to further the field. DATA SOURCES: Current temporal bone image acquisition and image processing established in the literature as well as in house methodological development. REVIEW METHODS: We reviewed the current English literature for the techniques used in computer-based temporal bone simulation systems to obtain and process anatomical data for use within the simulation. Search terms included "temporal bone simulation, surgical simulation, temporal bone." Articles were chosen and reviewed that directly addressed data acquisition and processing/segmentation and enhancement with emphasis given to computer-based systems. We present the results from this review in relationship to our approach. CONCLUSIONS: High-resolution CT imaging ([Formula: see text] voxel resolution), along with unique image processing and rendering algorithms, and structure-specific enhancement are needed for high-level training and assessment using temporal bone surgical simulators. Higher-resolution clinical scanning and automated processes that run in efficient time frames are needed before these systems can routinely support pre-surgical planning. Additionally, protocols such as that provided in this manuscript need to be disseminated to increase the number and variety of virtual temporal bones available for training and performance assessment.

Translating the simulation of procedural drilling techniques for interactive neurosurgical training.

BACKGROUND: Through previous efforts we have developed a fully virtual environment to provide procedural training of otologic surgical technique. The virtual environment is based on high-resolution volumetric data of the regional anatomy. These volumetric data help drive an interactive multisensory, ie, visual (stereo), aural (stereo), and tactile, simulation environment. Subsequently, we have extended our efforts to support the training of neurosurgical procedural technique as part of the Congress of Neurological Surgeons simulation initiative. OBJECTIVE: To deliberately study the integration of simulation technologies into the neurosurgical curriculum and to determine their efficacy in teaching minimally invasive cranial and skull base approaches. METHODS: We discuss issues of biofidelity and our methods to provide objective, quantitative and automated assessment for the residents. RESULTS: We conclude with a discussion of our experiences by reporting preliminary formative pilot studies and proposed approaches to take the simulation to the next level through additional validation studies. CONCLUSION: We have presented our efforts to translate an otologic simulation environment for use in the neurosurgical curriculum. We have demonstrated the initial proof of principles and define the steps to integrate and validate the system as an adjuvant to the neurosurgical curriculum.

Virtual mastoidectomy performance evaluation through multi-volume analysis.

PURPOSE: Development of a visualization system that provides surgical instructors with a method to compare the results of many virtual surgeries (n > 100). METHODS: A masked distance field models the overlap between expert and resident results. Multiple volume displays are used side-by-side with a 2D point display. RESULTS: Performance characteristics were examined by comparing the results of specific residents with those of experts and the entire class. CONCLUSIONS: The software provides a promising approach for comparing performance between large groups of residents learning mastoidectomy techniques.

Virtual temporal bone dissection system: OSU virtual temporal bone system: development and testing.

OBJECTIVES/HYPOTHESIS: The objective of this project was to develop a virtual temporal bone dissection system that would provide an enhanced educational experience for the training of otologic surgeons. STUDY DESIGN: A randomized, controlled, multi-institutional, single-blinded validation study. METHODS: The project encompassed four areas of emphasis: structural data acquisition, integration of the system, dissemination of the system, and validation. RESULTS: Structural acquisition was performed on multiple imaging platforms. Integration achieved a cost-effective system. Dissemination was achieved on different levels including casual interest, downloading of software, and full involvement in development and validation studies. A validation study was performed at eight different training institutions across the country using a two-arm randomized trial where study subjects were randomized to a 2-week practice session using either the virtual temporal bone or standard cadaveric temporal bones. Eighty subjects were enrolled and randomized to one of the two treatment arms; 65 completed the study. There was no difference between the two groups using a blinded rating tool to assess performance after training. CONCLUSIONS: A virtual temporal bone dissection system has been developed and compared to cadaveric temporal bones for practice using a multicenter trial. There was no statistical difference between practice on the current simulator compared to practice on human cadaveric temporal bones. Further refinements in structural acquisition and interface design have been identified, which can be implemented prior to full incorporation into training programs and used for objective skills assessment.

Virtual simulation of mouse anatomy and procedural techniques.

Translational science requires the use of mouse models for the characterization of disease and evaluation of treatment therapies. However, often there is a lack of comprehensive training for scientists in the systemic and regional anatomy of the mouse that limits their ability to perform studies involving complex interventional procedures. We present our methodologies for the development, evaluation, and dissemination of an interactive 3D mouse atlas that includes designs for presenting emulation of procedural technique. We present the novel integration of super-resolution imaging techniques, depth-of-field interactive volume rendering of large data, and the seamless delivery of remote visualization and interaction to thin clients.

Translating surgical metrics into automated assessments.

In the effort to promote more continuous and quantitative assessment of surgical proficiency, there is an increased need to define and establish common surgical metrics. Furthermore, as various pressures such as limited duty hours and access to educational resources, including materials and expertise, place increased demands on training, the value of quantitative automated assessment becomes increasingly apparent. We present our methods to establish common surgical metrics within the otology and neurotology community and our initial efforts in the subsequent transfer of these metrics into objective automated assessments provided via a simulation environment.

Automatic scoring of virtual mastoidectomies using expert examples.

PURPOSE: Automatic scoring of resident performance on a virtual mastoidectomy simulation system is needed to achieve consistent and efficient evaluations. By not requiring immediate expert intervention, the system provides a completely objective assessment of performance as well as a self-driven user assessment mechanism. METHODS: An iconic temporal bone with surgically important regions defined into a fully partitioned segmented dataset was created. Comparisons between expert-drilled bones and student-drilled bones were computed based on gradations with both Euclidean and Earth Mover's Distance. Using the features derived from these comparisons, a decision tree was constructed. This decision tree was used to determine scores of resident surgical performance. The algorithm was applied on multiple expert comparison bones and the scores averaged to provide reliability metric. RESULTS: The reliability metrics for the multi-grade scoring system are better in some cases than previously reported binary classification metrics. The two scoring methods given provide a trade-off between accuracy and speed. CONCLUSIONS: Comparison of virtually drilled bones with expert examples on a voxel level provides sufficient information to score them and provide several specific quality metrics. By merging scores from different expert examples, two related metrics were developed; one is slightly faster and less accurate, while a second is more accurate but takes more processing time.

Training and simulation in otolaryngology.

This article focuses on key issues surrounding the needs and application of simulation technologies for technical skills training in otolaryngology. The discussion includes an overview of key topics in training and learning, the application of these issues in simulation environments, and the subsequent applications of these simulation environments to otolaryngology. Examples of past applications are presented, with discussion of how the interplay of cultural changes in surgical training in general along with the rapid advancements in technology have shaped and influenced their adoption and adaptation. The authors conclude with emerging trends and potential influences advanced simulation and training will have on technical skills training in otolaryngology.

Creating a cross-institutional grading scale for temporal bone dissection.

OBJECTIVES/HYPOTHESIS: There is increasing interest in objective assessment of surgeon competence. In the field of otolaryngology, several surgical training programs, including The Ohio State University, the University of Toronto, and Stanford University, have pursued standardized criteria to rate their trainees' performance in the initial steps of temporal bone dissection (complete mastoidectomy with facial recess approach). Although these assessment metrics require the completion of similar basic components integral to successful temporal bone dissection, certain listed criteria are unique to each institution. Our aim was to establish a more standardized set of criteria that can be used across different institutions to objectively assess temporal bone dissection. We translated these new criteria into automated metrics in our temporal bone dissection simulator to achieve even more objective grading of temporal bone dissections. STUDY DESIGN: Cross-sectional study/survey. METHODS: The temporal bone assessment criteria developed by each of the three aforementioned institutions were compiled into an all-encompassing scale. This compilation was sent out as an online survey to members of the American Neurotology Society and American Otological Society with instructions to rate the importance of each criterion. RESULTS: Criteria that were ranked by >70% of respondents as either "very important" or "important" were used to create the new, cross-institutional scale for the objective assessment of temporal bone dissection. CONCLUSIONS: The new assessment scale and its eventual incorporation into the temporal bone surgical simulator will enhance the objectivity of currently existing methods to evaluate surgical performance across different institutions.

Radiographic anatomy of the infracochlear approach to the petrous apex for computer-assisted surgery.

OBJECTIVE: 1) To define the surgical anatomy and dimensions of the infracochlear approach to the petrous apex through the use of high-resolution computed tomography and 2) use of digitized images of cadaveric temporal bones for computer simulation of infracochlear access using the Ohio Supercomputer Center/Ohio State University temporal bone simulator. BACKGROUND: The petrous apex is a surgically challenging area to access. Many routes have been described and used successfully in clinical practice. However, these routes have not been defined with the aim of application in computer-assisted surgery. The infracochlear approach, due to its access via a transcanal route, affords the opportunity for its potential application in minimally invasive computer-assisted surgery. METHODS: High-resolution computed tomographic scans were performed on 102 cadaveric skulls (204 temporal bones). Standard measurements were taken using an open-source picture archiving and communication system software of the maximum height, width, and depth of the infracochlear approach. In addition, the maximum diameter of a circular fenestration that could be created in the infracochlear space without breaching the basal turn of the cochlea, internal carotid artery, or the jugular bulb was used to simulate a drill path. In addition, 5 temporal bone specimens (3 left, 2 right) underwent high-resolution computed tomography, with the digitized images being used to create simulated temporal bones for infracochlear surgical access; the transcanal infracochlear approach was then performed by the same surgeon on the cadaveric bone. RESULTS: The mean height, width, and depth of the infracochlear space in temporal bones with nonpneumatized petrous apices were 7.2 +/- 0.4, 9.4 +/- 0.8, and 17.5 +/- 1.0 mm, respectively. Corresponding dimensions in pneumatized petrous apices were 7.6 +/- 0.4, 10.1 +/- 1.1, and 18.6 +/- 0.8 mm, respectively. The mean diameter of the circular fenestra in the nonpneumatized petrous apices was 5.1 +/- 0.4 compared with 5.7 +/- 0.6 mm in pneumatized petrous pieces. This was statistically significant (unpaired t test; p value = 0.04). The time to perform a simulated infracochlear approach to the petrous apex ranged from 3.1 to 12.6 minutes (mean, 6.1 minutes). The time to perform the same approach on the cadaveric bone ranged from 4.32 to 14.1 minutes (mean, 9.3 minutes). CONCLUSION: Temporal bones with pneumatized petrous apices have an overall larger infracochlear space. The mean diameter of a circular infracochlear path that would avoid damage to vital structures was sufficiently large in both pneumatized and nonpneumatized petrous apices to have a potential application as a safe approach in computer-assisted surgery. Such an application is feasible with mating of a robotic system with computed tomographic- or magnetic resonance imaging-guided imagery, which is the next phase of this study.